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ABSTRACT 


The  segmented  approximation  problem  is  that  of  finding,  for  a 
given  function  x,  a  set  of  n  functions  in  some  collection  such 
that  the  supports  of  the  y  are  pairwise  disjoint  while  some  functional 
of  x-y  -  . . .  -  yn  is  minimized.  The  recursive  functional  equation  for 
the  "error"  of  the  best  approximation  by  n  functions  is  obtained  and 
continuity  of  the  "error"  as  a  function  of  the  set  on  which  approximation 
occurs  is  derived  from  weak  conditions  on  the  functional.  The 
allocation  of  the  reduction  in  "error"  attributable  to  each  of  the  y^^ 
is  studied  and  the  hereditary  nature  of  an  equal  allocation  principle 


is  established. 


APPROXIMATION  AND  ALLOCATION 


Arthur  Wouk 

1.  Let  X  denote  a  collection  of  vector  valued  functions  x  =  x(t)  from 

the  real  line  -  <*  <  t  <  ®o  into  some  normed  linear  vector  space  V  .  The 

support  of  x  e  X  is  the  complement  of  the  largest  open  set  on  the  t-line  on 

which  x(t)  is  the  zero  vector;  it  will  be  denoted  by  .  The  segmented 

approximation  problem  is  that  of  finding,  for  a  given  x  «  X,  a  set  of  n  vector 

valued  functions  y. ,  . . .  ,  y  .  contained  in  some  given  subset  M  of  X.  such 
i  n 

that  in  some  sense,  no  t  is  in  the  support  of  more  than  one  of  the  y  ,  while 
some  functional  5*  applied  to  x  -  y^  -  . . .  -y^  is  minimized.  Of  particular 
interest  in  numerical  computation  are  those  subsets  M  of  X  which  contain 
only  "trapezoidal  functions"  (functions  whose  support  is  a  finite  interval.) 
Functionals  of  interest  are,  for  example, 

CM  suPa<  t<b  Ilxli 

where  -*>  <_  a  <  b  <_  °o  and  il*  |]  is  the  norm  in  V,  and 

b 

ci. 2}  /  ikt)i!p  dpw  i  <_  P  <  °° 

a 
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where  p(t)  is  some  monotone  nondecreasing  function  of  t;  in  the  latter  case 
X  must  be  restricted  to  p-measurable  vector  valued  functions.  Special  cases 
of  these  problems  have  been  treated  (cf.  e.g. ,  [1],  [2],  [3],  [4])  where  the 
functions  y  are  trapezoidal,  and  either  linear  or  step  functions  of  t 
on  their  support,  and  x  is  a  continuous  real  valued  function  of  t  .  The 
structure  of  many  of  these  problems  is  easily  seen  (cf.  [1])  to  be  an  allocation 
problem;  in  the  case  of  the  supremum  norm,  it  is  characterized  by  the  principal 
that 

in  the  best  approximation,  the  amount  of  reduction  in  ^  attributable 

to  each  of  the  is  the  same. 

This  permits  a  recursive  approach  to  the  best  approximation  by  n  functions  y. 
and  requires  for  computational  purposes  only  knowledge  of  the  best  approximation 
by  one  function  y  on  suitably  arbitrary  subsets  of  .  (This  recursive  approach 
is  of  the  type  popularized  by  Bellman  under  the  name  dynamic  programming.) 

In  the  present  paper  general  properties  of  are  studied,  and  a  weak 
form  of  the  allocation  principle  is  associated  with  properties  of  the  best  single 
function  approximation.  Further  papers  will  consider  the  consequences  of  the 
allocation  principle,  and  specific  computational  procedures  for  segmented 
approximation. 

2.  In  the  examples  above,  5*  (or  a  power  of  ^  )  is  itself  a  norm  on  X;  if 
X  is  a  linear  space  and  V  is  complete,  then  $  makes  X  a  complete  space. 

It  might  seem  that  these  are  the  properties  of  ^  which  are  essential  to 
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approximation.  If  the  approximation  theory  is  to  be  compatible  with  the  linear 

structure  of  X  so  that  the  sum  of  two  approximations  is  an  approximation  to 

the  sum,  then  this  is  so.  If  instead  the  problem  is  posed  relative  to  a  fixed 

vector  valued  function  x,  this  is  no  longer  so.  The  basic  arguments  in  the 

proof  of  the  allocation  principle  are  on  certain  monotonicity  and  continuity 

properties  of  and  on  the  "adequacy"  of  the  set  M  .  To  make  matters 

precise,  suppose  that  x  has  support  in  a  fixed  interval  [a,b],  -°o  <_  a  <  b  <_  oo  } 

and  that  (x)  is  defined  (possibly  infinite)  for  all  arguments  used  below. 

A  partial  ordering  of  vector  valued  functions  will  be  used:  x  ■<  y  means 

x(t)  =  y(t)  for  all  t  €  .  Two  vector  valued  func. cions  x  and  y  are 

said  to  be  disjoint  if  Z?  (z)  =  0  for  every  z  e  X  with  S  Cs  nS  .  Let 

z  x  y 

3?  satisfy  the  following  conditions: 

(a)  if  x  -<  y,  then  3  (x)  <  ^  (y)  ; 

(b)  if  {x.^}  is  a  collection  of  elements  of  X,  0  <_  s  <_  oo  such 

that  x  -<  x  ,  whenever  s  >  s'  (hence  S  is  a  decreasing 
s  y  x 

s 

sequence  and  x  =  lim^^  xg  exists),  then  Zf  (xs)  -*•  Zf  (x),  s -*  oo 

(c)  3^  (0)  =  0  . 

The  approximation  problem  may  now  be  restated:  given  x  «  X  and  a  fixed  sub¬ 
set  M  of  X,  find  a  set  of  n  functions  y,,  ...,y  in  M  such  that 

1’  n 

(i)  if  i*j,  then  y^^  and  y,  are  disjoint; 


and 
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(ii)  (x  -  y  -  . .  .  -yn)  is  a  minimum. 

In  order  to  lend  interest  to  the  problem,  M  must  contain  a  reasonable  number 
of  functions;  most  important  for  the  arguments  will  be  the  following: 

(d)  if  E  is  any  subinterval  of  [a,b]  with  characteristic  function 
X£,  and  y  t  M,  then  y  •  x£  «  M  . 

If  sets  are  ordered  by  inclusion,  then  (a)  implies  that  3  (x  •  x^)  is  a  non¬ 
decreasing  set  function;  (b)  implies  it  is  an  "outer"  continuous  set  function, 
while  (c)  makes  it  nonnegative.  Together  (a)  and  (d)  imply 

(2.1)  3  ((x-y)  •  xE)  <  3  C(x-y)  •  xE  ) 

s 

whenever  eCe  .  If  E  is  a  decreasing  collection  of  sets  with  E  =  lim  E  , 
s  s  s 

then  (b)  implies  ^((x-y)  •  X£  )  “*■  ^7((x-y)'  Xe))s'*00  (outer  continuity. ) 

s 

Then  for  any  collection  M  the  following  holds: 

Theorem  2, 1  The  set  function 

Fl<El=in£y«M  ?  «*->’)  -XE) 

exists ,  and  is  an  outer  continuous  nonneqative  nondecreasinq  function  of  sets 
ordered  by  inclusion. 

The  only  nonimmediate  fact  is  the  outer  continuity  of  Fj  .  Suppose  in  fact 
that  for  some  collection  of  sets  Eg  which  is  decreasing  and  convergent  to  E  it 


is  true  that 
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F1CEs)  >  FjCE)  +  c 

where  c  is  some  positive  number.  Then 

^((x-y)  •  xE  )  >  FjtE)  +  c 
s 

for  any  c  .  Choose  y  so  that 

Tp)>  J  ((x-y)  -XE)  -  C./2  . 

Then 

3  ((x-y)  *XE  )  >  ^((x-y)  *x  )  +  c/2 
s  L 

for  all  s,  which  violates  the  outer  continuity  of  . 

Let  {y^,  y^}  ={y.)n  denote  a  collection  of  n  pairwise  disjoint 

elements  of  M  whose  supports  cover  [a,b]  .  Define 

F2tE)  slnf{y.)  ^((x-yj-yp  •  xE)  . 

1 

Suppose  further  that  for  any  disjoint  two  sets  E,  E',  there  is  defined  a  binary 
operation  e  such  that 

3(x-xEwE,h  ^(x -xE)  ®  *7(x  -xE.)  ; 

there  6  is  a  binary  operation  on  real  numbers  c  =  c(a,b)  =  a  6  b  which  is  a 
commutative,  associative,  and  continuous  nondecreasing  function  of  both 
arguments  and  which  satisfies  a  6O  =  O0a  =  a  .  Then 
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f2(e>  -  lnf{yi)2  5  «x'yi>  •  *e-s  y2) 9  3  «x-y2>  •xsy2> 

alnfTCElnJS  CE-Iln£S  Ct  5  '  XE-T*9^'(X"y2^'XE* 

y2 

=  inflCEF1(E-T)  9  F^T)  . 

Then  F  (E)  a  nonneqatlve.  nondecreasinq  outer  continuous  set  function. 

Again  the  only  part  of  this  statement  which  is  nonimmediate  is  the  outer 
continuity.  Suppose  in  fact  that  F2(E,)'>  F.,(E)  +  c,  c  >  0,  for  every  E‘  I)  E  . 

Then  for  any  tC  E 

F^T)  0  F  (E*-T)  >F2(E)  +  c  . 

Since  F^  is  outer  continuous,  this  implies 

FjCT)  9  F^E-T)  >F2(E)  +  c 

for  any  tC  E  and  hence  F.,(E)  >  F.,(E)  +  c,  which  is  impossible.  Next  we 
observe  that  F.,(E)  <_  F^(E)  since  a  Q  0  =  a  .  If  Fn(E)  is  defined  as 

Fn(E)  =  in£(yi)n  *  «x  ‘  VV  ' '  •  '  yn>  '  XE>  ’ 
then  a  similar  reasoning  shows  the  truth  of 

Theorem  2.2:  F^(E)  is  a  nondecreasinq  nonneqative  outer  continuous  set 
function;  as  a  function  of  n  it  satisfies 
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(2.  2}  Fn(E)  1  Fn_k(E)  ,  k  =  1,  . . . ,  n-1  .. 

Lastly  it  satisfies  the  functional  equations 

(2.  3)  Fn(E)  =  infT(-  £  Fk(T)  9  Fn_k(E-T}  ,  k  =  1,  . . . ,  n-1  , 

and 

(2.  4)  Fn(E)  =  inf{T  }  F^Tj)  9  F1(T{)  0  ...  9  F^TJ  , 

where  E  =  T,  w  T„  ^  T  and  T,  T.  is  empty  _if  i#  j  . 

1  it  n  l  j 

If,  in  (1.1),  x(t)  is  continuous  (in  the  strong  sense),  or,  in  (1.2),  p(t)  is 
absolutely  continuous,  then  ^  is  also  "inner  continuous":  that  is  EgC  Egl, 
for  s  <  s'  and  E  =  lim  E  imply 

S  ■“►00 

lim  $  (x  .Xg)  =  ^  (x  .X£)  . 


Then 

Theorem  2.  3:  If  3  is  also  inner  continuous,  then  so  is  Fn(E)  for  all  n  and 
is  in  fact  a  continuous  sot  function. 

The  proof  is  this  is  essentially  the  same  as  the  proof  of  Lemmas  1  and  2.  If  3^ 
is  both  inner  continuous  and  outer  continuous,  then  it  is  called  continuous. 

3.  In  the  absence  of  strong  assumptions  on  the  completeness  of  M  with 
respect  to  ^  ,  it  is  not  possible  to  assert  the  existence  of  best  segmented 
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approximations  and  give  a  proof  of  the  alLcca-tion  principle.  However,  the 
formal  nature  of  the  problem  is  already  so  strongly  determined  that  it  is 
possible  to  prove  the  equivalence  of  a  ras.tker  "naive"  analytic  property  of 
F  to  a  weakened  form  of  the  allocation  principle.  This  is  the  following: 

Weak  Allocation  Principle:  Given  army  set  E  and  any  £  >  0  there  exists 
a  collection  of  n  sets,  {T^} n  such  that 

i)  T^T  =  <>,  i*j;  i,  j  =1,  . . . ,  n  ; 

ii)  E  =  T.  ^  ^  ^  T  ; 

iii)  FjCTj}  =  F1(T2)  =  . . .  = 

iv)  FjtTj)  0  F1(T2)  9  .  . .  0  F^XJ  <  Fn(E)  +  £  . 

An  alternative  form  is  the  following: 

iv1)  F^E)  =  inf  .  FjtTj)  9  E^T  ,)  9  ...  8  FpJ 

*■  rn  *• 

where  {T^)n  is  any  collection  of  sets  satisfying  i),  ii),  and  iii)  . 

Theorem  3, 1  The  weak  allocation  principle  holds  if  and  only  if  for  every  set 
E  and  any  constant  €.  >  0  there  exists  a  s  et  tC  E  such  that 

i)  F^T)  0  F^T)  <  F2(E)  +  S  ; 

ii)  Fj(T)  >  F^(E  -  T)  . 

Proof:  It  may  be  supposed  that  F^(E)  >  O;  if  not,  the  theorem  is  vacuously 


true.  The  following  lemma  is  at  the  bottom  of  the  proof: 
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If  E  :  AUB  where  A  r\  B  =  <j>  and  F^ (A)  >  F^B) ,  then  there  exists 
A'C  A  and  BOB  such  that  F^A*)  =  F^B* }  .  The  deformation  A-*- A',  B-*B 
is  continuous. 

To  see  this,  consider  the  one  parameter  family  of  sets  A  =  A  r\  [t  s  ]  , 

S  1 

w'here  t,  <  t.  and  E  is  contained  in  ft.,t_}  .  Also  consider  B  =  E  -  A 
1-2  v  P  s  s 

Then  Fj(Ag)  is  a  continuous  nondecreasing  function  of  s,  g)  is  a 
continuous  nonincreasing  function  of  s,  and 

F  (A  }  =  0  <  F  (E)  =  F  (B  } 

1  1 

while 

F1(At  )  =  FjtA)  >  FjtB)  =  F1(Bt  )  . 

2  2 

Hence  for  some  s,  F1(Ag)  =  F^(B^)  . 

Suppose  now  that  the  weak  allocation  principle  I  is  true.  Then,  in  particular, 
for  any  E, 

(3.1)  F2(E)  =  inf{lCE  |  Fi(I)=  •  P,tE-T> 

so  that  for  any  €  >  0  there  exists  a  set  T  satisfying  i)  and  ii)  .  Conversely, 
suppose  that  for  any  E  and  any  £  >  0  there  exists  tC  E  satisfying  i)  and 
ii)  .  Then  the  lemma  implies  that  there  exists  T'C  T  such  that 

F2(E)  <  F^T1)  0  F^E-T')  <  FjCT)  0  F^T)  <  F  (E)  +  £ 
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Then  (3.1)  is  true. 

Next  the  conditions  i)  and  ii)  must  be  lifted  to  the  case  of  decompositions 

of  E  into  three  sets  (and  then  by  induction  into  n  sets  for  any  n  .)  The 

lifting  process  goes  as  follows:  from  the  definition  of  infimum  we  conclude  the 

existence  of  {T,}„  such  that 
i  3 

F^)  0  F1(T2)  0  Fj(T3)  <  F3(E)  -  V 

for  any  positive  numbers  r|>  V  such  that  t|  -  y  >  0  .  The  lemma  implies  that 
it  is  always  possible  to  choose  {T,}  so  that  F  (T  )  =  F  (T  )  >  F  (T  )  .  Should 

1  j  XX  X  l*  X  j 

F1(T2)  =  ,  nothing  needs  to  be  shown;  suppose  instead  that  a  strict 

inequality  holds.  Now  F^T^  0  F^)  =  F2(T2  T3)  +  c  for  some  c  >  0  . 

Then  there  exists  a  decomposition  of  T  T  into  T  ’  '  such  that 

^  J  o  j 

T2'C  T  ,  T3C  T3*  and 

FjCT2«)  -  F1(T3')  =  1/2  {Fj(T2)  -f^)} 

while 

f1(t2i)  0  f1(t3i)  <  f:(t2)  0  Fj(T3)  . 

This  follows  by  using  (i),  (ii)  and  modifying  slightly  the  proof  of  the  lemma 
above.  Then, 


Fi(Ti)  0  f1(t2«)  o  f1(t3')  <  f3(e)  +  n  -  v  . 
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A  direct  application  of  the  lemma  permits  the  replacement  of  Tj  and  T^'  by 
a  new  pair  of  sets  and  T3*  with  F^*)  >  F^'J  >  F^*)  and 

F^*)  6  F^T^}  6  F^*)  <  F3(E)  +  ti  -  v  , 

where  either  F^*)  =  F^T.,'}  or  F^*)  =  F^*}  .  If  F^*)  =  F^T^)  , 
notice  that 

Fit1!*)  -  Fi(T3*)  <  f1(T2')  -  F^Ts') 

<  1/2  {F^)  -  F1(T3)}  . 

If  instead,  F^T^)  =  F^T^},  then  use  the  fact  that 

F^')  =  F1(T3'}  +  1/2  (F^)  -  FjCT3)} 

>1/2{F1(T1)  -FjCT^} 

to  conclude  that 


F^*}  -  F1(T3>f}<  F^T^  -  F^T.,*} 

<  i/2{f1(t1)-f1(t3)>  . 

Thus  it  is  always  possible  to  assume,  for  any  6  >  0  ,  that  the  {T^} 3  are 
such  that  F^}  =  F1(T2)  >  F^}  >  F^}  -  6  . 

The  function  a  0  (3  9  y  is  a  continuous  function  of  the  three  variables  on 
the  closed  set  0  <_  a<_  F^E),  0  <_  (3<_  F^(E),  0  <_  y  <_  F^(E)  .  Hence  it  is 
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uniformly  continuous  there;  given  any  y  >  0  there  is  a  6  >  0  such  that 

|ar0(30(Y“A}-a0f3  0'Y!<v  if  |a|  <  6  . 

Thus  it  can  be  asserted  that 

(3.  3)  ©  FjCTj)  0  FjCTj)  <  F3(E)  +  r,  . 

This  lifts  (i)  to  the  present  case  while  (ii)  has  always  been  preserved.  If 
T,  and  T  have  the  customary  meaning  and  T,  =  E  -  T  -  T  ,  then  the 

IS  2S  3S  IS  2S 

lemma  is  reapplied  to  rearrange  T^g  and  T^  ,  for  each  s,  to  make 

F,(T.  )  =  T,(T-  )  .  Then  for  some  s,  F,(T,  }  is  the  same  for  i  =  1,2,3,  while 
r  is'  r  2s'  ’  r  is' 

(3.  3)  is  preserved.  This  lifts  the  lemma.  Thus  it  has  been  shown  that  the  weak 
allocation  principle  holds  for  n  =  3  .  The  inductive  argument  is  now  clear. 

The  uniform  continuity  of  the  iterated  binary  operation  i$  still  available,  and 
the  lifting  argument  for  passing  from  (i)  to  its  equivalent  for  {T^  goes  over 
directly  to  the  general  case.  The  general  form  of  the  lemma  also  presents  no 
difficulties.  ~ 

Theorem  3. 1  can  be  viewed  as  saying  that  if  the  weak  allocation  principle 
holds  for  n  =  2,  then  it  holds  for  all  n  >  2  .  It  would  be  desirable  to  show 
that  if  the  weak  allocation  principle  holds  for  some  n  =  N  >  2,  then  it  holds 
for  n  =  2  (and  hence  for  all  n  >  2  .}  The  present  assumptions  on  M  and  3 
do  not  yield  this  result;  instead  the  following  weaker-  result  will  be  established: 
Theorem  3,2:  Jf  cQc  is  a  strictly  increasing  function  of  c  and  if  there  is  a 
positive  Constance  6  such  that  for  any  set  E 
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(3.4)  (l+6)  F2(E)  <  inf{Fi(T)  =  Fi(I_T)}  FjlT)  ®  F^E-T)  , 

then  the  weak  allocation  principle  does  not  hold  for  any  set  E  with  F^(E)  >  0 
n  >  2  , 

Proof.  Since  N  =  2  is  trivial,  let  N  >  2  and  F^(E)  >  0  .  For  any  decomposition 
of  E 

(3.5)  FN(E)  <Fz(T^T2)  0  FN.2(E-T1UT2) 

<  [(1+  6)" 1  [  F^)  0  F1(T2)  ]  j  0  Fp3)  0  ...  0  F:(Tn) 

<  Fj(Tj)  «  F1(T2)  0  ...  0  F^Tjj)  . 

We  may  of  course  assume  F  (T.)  constant,  i  =  1,  . . .  ,  N  . 

As  a  function  of  c  ,  11 

N 

fN(c)  =  c0c@\..  0" = 

is  strictly  increasing;  then  there  is  a  c  >  0  with  F„T(E)  =  f  (c)  .  Furthermore 

N  N 

(3.5)  implies  F^T^)  >  c,  i  =  1,  ...,  N  .  Also,  there  exists  aA>0  such  that 

(1+6)  1  [c  0  c]|  0  c  0  ...  0  c+  A  <  f^c)  . 

From  (3.  5)  it  follows  that 

(3-  6)  Fn(E)  <  F2(Tj  w  T2)  0  Fn  _  2(E  -  T2  w  T2)‘  +  A  <  F^}  0  . . .  0  F^)  . 
Taking  the  infimum  of  (3.  6)  for  all  admis  sable  decompositions  of  E  implies 
FN(E)  +  A  <  inf  {  }  F1(T1)  0  ...  @  F2(Tn)  , 
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which  contradicts  the  possibility  that  the  weak  allocation  principle  holds 
for  n  =  N  . 

Notice  that  if  6  were  dependent  upon  the  set  E,  and  not  bounded  away 
from  zero,  then  A  would  not  be  bounded  away  from  zero  and  the  contradiction 
would  disappear.  Also  remark  that  if  the  assumptions  on  M  and  were  such 
as  to  guarantee  that  the  infimum  was  achieved  for  some  decomposition  of  E  , 
then  the  above  proof  can  be  reworked  somewhat  to  show  that  the  weak  allocation 
principle  for  n  =  N  >  2  implies  the  principle  for  n  =  2  (and  hence  for  all 
n  >  2  . ) 
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